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Stochastic dynamics in the energy representation is used as a novel method to 
represent nonequihbrium Brownian-Uke systems. It is shown that the equation of 
motion for the energy of such systems can be taken in the form of the Langevin 
equation with multiphcative noise. Properties of the steady states are examined 
by solving the Fokker-Planck equation for the energy distribution functions. The 
generahzed integral fluctuation theorem is deduced for the systems characterized by 
the shifted probability flux operator. From this theorem, a number of entropy and 
fluctuation relations such as the Evans-Searles fluctuation theorem, the Hatano-Sasa 
identity and the Jarzynski's equality are derived. 
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I. INTRODUCTION 

According to the basic principles of thermodynamics, when a macroscopic system is 
brought into contact with a thermostat (reservoir, heat bath), the system evolves in time 
approaching the equilibrium state in the course of relaxation. The state of equilibrium 
is well-defined only under certain idealized conditions [l|-|3| so that, at equilibrium, the 
thermodynamical parameters of the system are adjusted to the values of the thermostat 
whereas all intrinsic flows have come to an end. 

In most cases, however, systems are subject to nonequilibrium conditions and external 
constraints [3-9]. In open systems out of equilibrium, flows universally present and generally 
cannot cease to exist. So, it is difficult if not impossible to determine governing parameters 
that can be held constant. 

Nevertheless, there are the stationary states that can be unambiguously defined for cer- 
tain open systems Although such states are independent of time and thus might be 
regarded as "equilibrium" ones, the thermodynamical parameters of the system may signifi- 
cantly differ from those for the environment and, more generally, the stationary distribution 
functions cannot be described using the well-known equilibrium distributions. 

Among all the nonequilibrium systems, the most studied and important case is repre- 
sented by an ensemble of Brownian particles. In spite of the fact that Brownian motion 
has long been the subject of intense studies (a recent review on its history can be found 
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id, lUl), it is still interesting to understand the behavior of Brownian particles as a model 



system driven far from equilibrium. 

It should be emphasized that the theory of Brownian motion can be applied to the 
systems where the term "Brownian particle" does not mean a real particle. For example, 
it may point to some collective property of macroscopic systems such as the concentration 
of any component of a chemically reacting system [7|. For brevity, such systems will be 
referred to as the Brownian systems. 

Though far-from-equilibrium Brownian systems are abundant in nature, there is no uni- 
fied commonly accepted theoretical approach to determine possible states of such systems. 
Hence it is a fundamentally important task to develop a method to explore general properties 
of stationary states of open systems and to establish the conditions of their existence. 

In equilibrium statistical mechanics, these states are known to be generally described in 
terms of the energy surfaces giving, for certain systems, microcanonical and canonical ensem- 
bles [11,0]. In a similar spirit, our considerations will be based on the energy representation 
where the states of the Brownian system are determined solely by their energies. 

Note that similar representation has been previously used in energy controlled stochastic 
models such as the random energy model 12, 3] and its generalizations 14] . The energy 



master equation was also derived in Ref. [15| as an low-temperature approximation describing 
energy fluctuations in the Bassler's phenomenological random-walk model for viscous liquids. 

Typically, the interaction between the Brownian system such as a Brownian particle and 
the environment involves the process of direct energy interchange. During this process, the 
dissipation may take the energy away from the system leading to a loss of its energy (the 
positive friction). In the opposite case of negative friction, the transfer of energy from the 
thermostat results in the energy input. 

In addition to the deterministic part of interaction, there are fluctuation effects of the 
environment that affect the system giving rise to rapid change of its state. Such changes 
may take place when the structure of the environment is complicated by the presence of 
additional systems or some of its characteristics can be directly influenced by the processes 
running in the Brownian system. 

So, the above pattern suggests using stochastic dynamics to describe the behavior of 
Brownian systems interacting with surrounding media. Therefore, there is an ensemble of 
such systems characterized by the probability distribution function that, in particular, define 
stationary (steady) states formed under nonequilibrium conditions. Typically, in systems far 
from equilibrium, the distribution functions of the stationary states significantly differ from 
the well-known equilibrium distributions. For example, dissipative dynamics of the noise 
driven Hookean model for protein folding studied in Ref. [l6[ was found to be characterized 
by a distribution of energy states obeying a modified one- dimensional Ornstein-Uhlenbeck 
process. 

In this paper we suggest using the Langevin dynamics [l7, 18] in the energy representation 
to describe the class of systems called the Brownian systems. Properties of the stationary 
(steady) states of such systems will be of our primary concern. The layout of the paper is 
as follows. 

In Sec. ini we start with the purely dissipative dynamics of Brownian particles and show 
that, in the energy representation, it is governed by the Langevin equation with the multi- 
plicative white noise. Then we generalize the results for the Brownian particles and formulate 
the Langevin equation ([7j) for out-of-equilibrium Brownian-like systems. 

In Sec. the steady states of the Brownian systems are obtained as the stationary 
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solutions of the Fokker-Planck equation and are characterized by the probabihty flux number, 
Jst- It is found that the steady state distributions are additionally determined by the effective 
energy potential ( TT^ and by the energy dependent diffusion coefficient. We also discuss some 
important examples of the steady states formed when the probability flux vanishes, Jst = 0, 
and the distributions take the potential form. 

In Sec. IIV A| we deflne the trajectory dependent entropies whose ensemble averages can 
be associated with the entropy production rates of the system and of the environment. The 
steady state values of the rates are evaluated. The rate of the medium entropy is found 
to depend heavily on the effective potential. Then, in Sec. IIVB[ we derive the generalized 
integral fluctuation relation fH7|) for Brownian systems with the shifted probability flux op- 
erator characterized by the flux parameter and the probability flux number. It is shown that 
there are a number of the known fluctuation relations along with the fluctuation-dissipation 
theorem for the steady-state systems that immediately follow from the relation (147|) . 

We discuss our results and make some concluding remarks in Sec. |Vl 



II. BROWNIAN PARTICLES AND ENERGY REPRESENTATION 

A. Brownian particles 

The energy representation, where the states of the system are distinguished solely by 
their energies, e, can be viewed as the very basic description of the nonequilibrium system 
behavior provided that other dynamical variables, for some reasons, are irrelevant and can 
be disregarded. In this section, the well-known case of purely dissipative dynamics of a 
Brownian particle [l9| will be our initial concern. For this simple model system, we introduce 
the energy representation by deriving the Langevin equation for the energy of the particle. 

So, we take, as the starting point, the following Langevin equation 

dtPi = Fi + r]i, (1) 

dE 

where p = (pi,P2,P3) is the momentum of the particle: Fi = — — — = —diE is the ith 

dpi 

component of the force expressed in terms of the potential, E = E{p). Note that the linear 
friction force F = — 7p represents the special case where the potential is proportional to the 
kinetic energy, e = p^/(2M) (M is the particle mass): E = 7p^/2 = jMe, (7 is the friction 
coefficient). 

For the white Gaussian noise with {rii{t)) = and {r]i{t)r]j{t')) = 2cx^6ij6{t - 1'), where 
2cr^ is the intensity of the random force, Eq. ([1]) is known to give the Fokker-Planck (FP) 
equation 

dtP{p, t) = d, [a^ d, - F,] P(p, t) (2) 

describing the stochastic dynamics as the evolution of the probability distribution function 
P(p,t) = ((5(p(t) — p)). The equilibrium distribution 

Peq(p) oc exp[-Eip)/a'] (3) 



then can be derived as the stationary solution to the FP equation ([2]). For E = jMe, 
Eq- ^ gives the well-known Boltzmann distribution provided the friction coefficient, 7, the 
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mass, M, and the noise intensity, a^, are related to the inverse temperature, (3 = l/^ksT), 
through the Einstein relation: 'yM/a'^ = /3. 

Our task now is to deduce the Langevin equation for the energy of the Brownian particle, 
6. To this end we start from the FP equation written in the spherical coordinates (p, 6, (p). 
Then, after averaging over angles and making the change of variables, p — )■ e = p^/(2M), 
we have 

dtP{e, t) = d, [d^ ^d,^+{eE'- a^)] p{e, t), (4) 

where = cr^/(8M), E = E/{8M), P{e,t) is the energy distribution function and prime 
stands for the derivative with respect to the energy, e. 

The steady state distribution found as the stationary solution of the FP equation in the 
energy representation (j4j) is given by 

Pe^{e)cxVIexp[-a-^E{e)]. (5) 

The difference between the distributions given in Eq. ([3]) and Eq. ([5]) is due to the additional 
square root factor y/e that accounts for the Jacobian of the transformation: p^dp oc y/ede. 

For the Boltzmann equilibrium distribution with E/a"^ = E/a'^ = I3e, it can be readily 
seen that the function reaches its maximum value at e = ksT /2 and the equilibrium mean 
value of the energy is (f^)^^ = 3kBT/2. This case represents the equilibrium conditions, when 
the Brownian system is at equilibrium and the environment plays the role of the thermostat. 

Finally, from Eq. (jl]), it can be inferred that the Langevin equation in the energy repre- 
sentation is given by 

dte = -{eE' - d^) + v^77(t), (r/(t)7)(t')> = 2^^ 5{t - t'). (6) 

This result shows that the stochastic equation governing the dynamics of the Brownian 
particle energy is characterized by the multiplicative noise. 

Note that, though different representations of the Brownian motion are equivalent, the 
energy representation can be the preferential approach when it is necessary to take into 
account both loss and gain (dissipation and absorption) of the energy. The latter process 
implies that the Brownian particle is subjected to "negative" friction. 

We can now draw some generalizations from the results for the Brownian particle and 
treat the general case of Brownian systems. 



B. Langevin dynamics in energy representation 

Our basic assumption is that, similar to the above discussed Brownian particle, the energy 
dynamics of the Brownian system is governed by the Langevin equation with multiplicative 
noise of the general form 

d,e = -f{e)+g{e)m. (7) 

where e is the energy, f{e) is the function giving the rate of direct energy exchange and g{e) 
is the energy diffusion function; C,{t) represents Gaussian white noise. Mathematically, this 
equation can be regarded as the generalized version of Eq. ([6]), where f{e) = eE' — a"^ and 
g{e) = y/e. 

The first term on the right hand side of dynamical equation ([7]) is due to the direct 
action of the environment on the system. The effect of direct external action described by 



5 



the exchange function, f{e), is determined by the conditions under which the system is kept 
and by its physical characteristics. 

But evolution of the system state is not determined solely by these factors. Each param- 
eter of the system may undergo irregular variations caused either by fluctuation induced 
stochastic perturbations or by the complicated dynamical behavior of a nonlinear environ- 
ment. These additional variations result in random migration of the system over various 
states. 

Random influence of the environment is represented by the second term on the right 
hand side of Eq. ([7j). This term accounts for the system-environment interaction induced 
by fluctuations in parameters of the system controlling conditions. It is taken in the form of 
multiplicative noise with the diffusion function, g{e), giving the energy dependent coupling 
strength. 

Thus, for the Brownian system in contact with the environment, there are processes 
leading to gain and loss of the energy that underlie the Langevin dynamics in the energy 
representations. Our next problem is to identify the conditions for the system to be at 
equilibrium stationary states and to find the distribution function of the system out-of- 
equilibrium. 



III. NONEQUILIBRIUM STEADY STATES 

In the previous section we have found that, for the energy of the Brownian particle 
expressed in terms of the momenta, the stochastic dynamics is governed by the Langevin 
equation ([6]). 

In more general nonequilibrium systems, it does not always happen that all necessary 
details on the dynamics of internal degrees of freedom such as the momenta are known. 
These nonequilibrium systems can be characterized by the energy dependent probability 
distribution function p{e,t) = (^S{e{t) — e)) describing the dynamical behavior that involve 
the processes of energy loss and gain induced by the environment. 

Generally, the equation of motion for the energy change of out-of-equilibrium systems is 
complicated by nonlinearities present in both the internal dynamics of the system and in 
the system-environment coupling. For Brownian systems in the energy representation, this 
complexity can be described using the nonlinear Langevin equation with the multiplicative 
noise ([7]) that define the nonlinear stochastic out-of-equilibrium dynamics. 

In this section, we begin with the dynamics of the probability distribution function, 
p{e,t), and then examine the properties of the steady states. These are defined as the 
stationary solutions of the FP equation in the energy representation. This approach to the 
steady states closely resembles the widely accepted definition of the equilibrium distribution 
function which implies that, for a typical system, the distribution is determined solely by 
the energy as the only known integral of motion. 



A. Fokker- Planck dynamics 

Our first step is to deduce the FP equation that define how the energy distribution p{e, t) 
evolves in time. To this end, we adopt the symmetric Stratonovich convention and apply 
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the standard procedure [19|, l20| to the Langevin equation ([7]) giving the following result: 

d,p{e,t) = d,[a'g{e)d,g{e) + /(e)] p{e,t). (8) 

Note that there are different interpretations of the Langevin equation ([7]) that all boil 
down to providing the discretization rules employed to define the stochastic integral: 
j^^^^ g{e{T))^{T)dT. Mathematically rigorous considerations of stochastic differential equa- 
tions are mostly based on the Ito calculus (the prepoint discretization rule), whereas the 
Stratonovich interpretation (the midpoint discretization rule) has simpler transformation 
properties under a change of variables and arises naturally when the delta-correlated noise is 
treated as the limiting case of a real noise with finite correlation time (colored noise). Since 
the drift term in the FP equation depends on the prescription for evaluating multiplicative 
noise (the results for the generalized Stratonovich prescription can be found in Ref. j2l|). 



the problem known as the Ito-Stratonovich dillema arises [20|, 122|, |23|. Mathematically, 
the results for the Ito and Stratonovich stochastic differential equations are in one-to-one 
correspondence. But this correspondence is system dependent. So, additional information 
about the microscopic structure of the environment is required in order to decide which dis- 
cretization rule is physically adequate (discussion of the dilemma in the context of "internal 
and external" noise is given in Chap. IX. 5 of van Kampen's textbook (23|). 

The FP equation in the energy representation can now be conveniently recast into 
the divergence form giving the conservation law 

M^, t) _ dJ{€,p) , . 

dt de ' 

characterized by the probability flux J 

J = D{e){v'{e) + d,'jp = J-p (10) 



J = D{e)\v'{s) + dA, (11) 



with the flux operator 



where D{e) = a'^g'^{e) is the diffusion coefficient and V is the effective energy potential given 
by 

V{e) = \n\g{e)\+ f f{e')/D{e')Ae'. (12) 

For the values of energy e ranged between e-cain and £max, ^ £ [f^min, f^max], the conservation 
law dni) combined with the normalization condition, pde = 1, gives the condition of 

conservation for the flow of probability: J\e=en-,in = J\e=em^^ = Jb- 

Temporal evolution of the probability distribution function p is governed by the evolution 
operator, U{t,to), of the Fokker-Planck equation ([9]). This operator can be found as the 
solution of the following initial value problem: 

-dtU{t,to)=n-l({fto), U{to,to)=I, (13) 

n = -de-J, J = D[V' + de], (14) 
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where X is the identity operator; % is the Fokker-Planck operator that plays the role of the 
effective Hamiltonian related to the probability flux operator f lTT]) . 

Thus the probability distribution p{e, t) evolves in time under the action of the evolu- 
tion operator. This can be conveniently expressed using the quantum mechanical bracket 



notations as follows [19|, l2J, [25 



\p{t))=U{tM) |p(to)>, p{e,t) = {e\p{t)). 



(15) 



B. Stationary distributions 

The general stationary solution of the FP equation ([8]) 

p,,{e) = exp[-V(£)]|iV,t + ^ f exv[V{e')\/D{e')de'\, (16) 

where Jst = Jb{pst) is the stationary probability current and Ngt is the nomarlization con- 
stant, can be easily obtained by solving the first-order linear differential equation: J ■ Pst = 
Jst- Note that the bracket form of the equation for the steady states is 

^|Pst> = l^st), (17) 

where pstie) = {e\pst) and (^l Jst) = Jst- 

In the remaining part of the section we assume reflecting boundary conditions and restrict 
ourselves to the important special case where the stationary flow is absent, Jst = 0. For in- 
stance, such boundary conditions apply to the case when the energy spectrum is unbounded 
from above, e^aax oo and e^am < s < oo, and the steady state distribution function rapidly 
decays to zero with the energy: pst — at e — )■ cxd. 

So, the steady state distribution flTBl) takes the potential form 



Pst 



[e) = exp {-V{e)} , Z^t = exp[-V {e)]de . (18) 



Note that, by analogy with equilibrium systems, the quantity Fst = — \nZst sometimes is 
referred to as the effective f ree energy |26j. 

The shape of the distribution (fT8|) is determined by the effective energy potential given 
in Eq. (fT2i) . In particular, the distribution function reaches its extremal value at energies 
determined by the stationary points, e = Eg, of the potential V. These points can be found 
from the stationarity equation 

V'iss) = {D'ie,) + 2f{Es)) = (19) 

that can be regarded as the condition of diffusion-drift balance, <y'^g{Ss)9'{^s) = ^fi^s), 
between the diffusion over states of the environment and the dissipation in the system. 
This balance condition gives the value of most probable steady state energy, e = Em, which 
corresponds to the minimum of the energy potential V. 

In the vicinity of the most probable energy, the steady state distribution can be approx- 
imated by the Gaussian function 

Pst{e) ~ Pg(£) oc Pstism) exp [-V"{e^){6 - emf/2] , (20) 
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where V"{em) = [D"{em) + 2/'(em)]/(2-D(£m)) is the second derivative of the potential with 
respect to the energy. 

There are a variety of typical cases representing newly formed steady states of nonequi- 
librium systems depending on the dissipation and diffusion functions, f{e) and g{e). Below 
we discuss some of the most important ones. 

We begin with the noiseless case by assuming the singular limit of vanishing diffusion, 
(7 — 7- 0. Then temporal evolution of the energy distribution function initially prepared at 
e = Sq with p{e, 0) = 6{e — Eq), is as follows 

p{e,t) = 5{e-e{eo,t)), (21) 

where e{eQ,t) is the solution of the initial value problem: 

dte = -f{e) = -E'{e), e{0) = Sq. (22) 

Suppose that there is a local minimum of the potential E{e) located at £ = Sg- Then 
the energy Eg is the attracting stationary (equilibrium) point that defines the stationary 
distribution Psti^) = — £s)- This implies that, when the initial value of the energy, Eq, 
falls within the corresponding basin of attraction, the distribution functions (12T|) evolve in 
time approaching the steady state: p{E,t) — )• S{e — Eg) at t — )■ 00. 

Interestingly, when the diffusion function is a nonzero constant, g{E) = go ^ 0, the 
steady state distribution is Psti^) = N exp[—E{E) / Dq], where Dq = cr^gQ, so that its maxima 
correspond to the equilibria of the potential E. By contrast to the noiseless case, at go 7^ 0, 
we can have the steady state even without equilibria. An important example is the canonical 
equilibrium Boltzmann-Gibbs (BG) distribution with E{e)/Dq = [5e. 

Note that the steady state function takes the form of "microcanonical distribution", 
Pst(^) = ^{.^ — ^0)1 parametrized by the energy value Eq, only if the energy is conserved, 
/(e) = 0, and diffusion is absent, g{E) = 0. 

The limiting case with vanishing exchange function, /(e) = 0, describes the diffusion 
controlled systems. From Eq. (fT8|) . we obtain the stationary distribution function Psti^) = 
N\g{E)\~^ expressed in terms of the diffusion function g{E). The BG distribution, Pbg{.^) = 
A^exp[— /^e], can be realized as the steady state distribution only if the diffusion coefficient 
depends exponentially on the energy: D{e) oc exp[2/3£:], where /3 is the inverse temperature. 
The exponential dependence may emerge as the special feature of the interaction between 
the system and the environment. 

The above considerations are also applicable to the systems of Brownian particles in 
a randomly inhomogeneous environment. In such environment, some characteristics such 
as the coupling constants and the friction coefficient may contain stochasticity induced 
contributions and thus become random variables. Examples include large particles in the 
inhomogeneous environment, impurity particles placed into the dusty plasma, as well as 
the systems whose kinetic properties depend nonlinearly on the velocity or the energy of 
particles. 

As another simple example, we consider what happen when the second viscosity in mix- 
tures and acoustic flow comes into play due to the dependence of the friction coefficient on 
the velocity (27|. In this case we can take the assumption that, in the Langevin equation ([7]) 
with the linear exchange function /(e) = 75, the friction coefficient 7 = (7) + ^{t) is a sum 
of its average value, (7), and the noise term ^ that accounts for random variations of the 
friction coefficient in the environment that occur on the scales much less than those of the 
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observed spatial variations of kinetic processes. From Eq. ( ITS]) with f{e) = •ye and g{e) = e, 
we obtain the power law 

p,t(^)=iV/£^ (23) 



where i' = 1 + (7)/(T^, describing the dependence of the stationary distribution on the energy. 
Note that similar result can be found in Ref. 22j and the above power law distribution 
significantly differs from the well-known solution for the case where the coefficients of friction 
and diffusion are independent of the energy. 

In the case of the "negative friction" with {^7) < 0, the system absorbs the energy and, for 
the semi- indefinite energy interval [emin, 00), the stationary solution (123|1 does not represent 
the steady state distribution as it fails to meet the normalization condition. So, in order to 
have a steady state, we need to introduce a mechanism that limits the energy absorption. 
For this purpose, we consider the system characterized by the quadratic exchange function 
f{e) = (7)5 + 726^, where the second order term with the positive coefficient 72 > bounds 
the energy absorption from above, so that / > at e > max{ — (7^/72, 0}. At 72 > 0, the 
power law distribution (123!) assumes the following modified form: 



72 ■ 
2^ 



(24) 



Interestingly, at 72/0"^ = /? and v = (2 — n)/2 [(7)/o"^ = —nl'2\^ the steady state distribu- 
tion f l24p gives the well-known Maxwell distribution function of Brownian particles moving 
in the n-dimensional Euclidean space. 

In conclusion, let us briefly comment on the so-called phenomenological Rayleigh model 



of active friction j28|. In this model, the friction coefficient expressed in terms of the velocity 
7 = —70 + = l2{v'^ — Vq) = a{e — Eq), where Vq = 70/72, is negative at small velocities, 
v"^ < Vq, and, in the low energy region, the system absorbs the energy from the environment. 
By contrast, in the high energy region where e > Eq, the friction coefficient is positive and 
characterizes the exchange process accompanied by the loss of energy. In the case of the 
constant diffusion coefficient Dq = ct^Qq with g = go, the steady state distribution is given 
by 



Pstie) = iVexp 



a 



{e-eo)\e + eo/2) 



(25) 



The only maximum of this distribution is located at e = Eq giving the most probable value 
of the energy that defines the unique steady state distribution Psti^) = S{£ — £o) in the limit 
of low noise gQ ^ 0. 



IV. ENTROPY AND FLUCTUATION RELATIONS 

A. Entropies and effective potential 

In Sec. mil we have found that, when the stationary probability flux is zero, Jst = 0, 
the steady state distribution (1181) in the energy representation is completely determined by 
the effective energy potential f[T^ . whereas, in more general case with non- vanishing flux, 
<^t 7^ 0, the stationary distribution ([TB|1 additionally depends on the diffusion coefficient D. 
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In order to further clarify the role of the effective potential we consider the trajectory- 
dependent entropy of the system [29|, 



sit) 



In 



p{e,t) 



(26) 



defined for the trajectory e{t; ^) representing the noise dependent solution of the Langevin 
equation ([7]). 

Averaging the trajectory-dependent entropy fl2Bl) over noise gives the well-known result 

{s{t)) = - J p{e,t)\n[p{e,t)]de (27) 
that can be easily obtained using the general relation 

{<P{e{t; 0)> = / {5{e{t; - e))<P{e) de = [ pis, ds ^ (0|p(t)>, (28) 



where is a function of the energy and integrals are taken over the whole energy range. 
Another useful identity 

(0(£(t;O)^(t;O> = j{Sieit;0-6)iit;0)mde=- J .7(8, p)<Pie) de ^ -{<p\j\p) (29) 

is at the heart of the derivation of the FP equation Q. 

In the equation of motion for the entropy of the system fl26|l 



s{t) = -idtp + p'e)/p = - 



dtp J£ 
L p Dp 



+ V'e 



(30) 



we may single out the contribution due to change in entropy of the environment, Sm, related 
to the rate of heat exchange in the medium 



im(t) = -Vs. 

By using the identity (l29l) it is not difficult to evaluate its average 

(sM) = J J{e,p)V'{e) de. 



(31) 



(32) 



Similarly, averaging the increase in the total entropy Stot = s -|- Sm gives the expression for 
the total entropy production rate 



J\e,p) 
D{e)p{e,t) 



de> 



(33) 



which clearly cannot be negative. Upon reaching the steady state characterized by the 
stationary distribution flTB]) . the production rates of the total and medium entropies take 
their steady state values given by 



^■Stot) 
Sni) 



St 



D{e)pst{e) 



de = Jst In 



1 + Jst/A^st / exp{V{e)}/Die)de 



(34) 
(35) 
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where AV^ = V^(emax) — ^(^min)- As evident from Eqs. (IMl) and the entropy production 
rates both tend to zero only if the stationary flux vanishes, Jst = 0. 

In the path integral representation, Langevin dynamics governed by the equation of 
motion ([7]) is described by the generating functional of correlation functions, written 



in the functional integral form [19|, ISjJ . Applying the standard procedure [32, l33| , we deduce 
the generating functional 

G[A] = j V[e]\{g~^ew[-S,^[e] + A{T)e{r)dr'j (36) 



expressed in terms of the effective action 

1 fUie + DVy 



that determines the weight, P[e] oc exp(— ^efr), of a trajectory efr). Equation ( 137|) agrees 
with the results for the effective action previously derived in Refs [2l|, |3J, |35 . 

From the expression fl37|l . it is straightforward to evaluate the difference in the effective 
action for each forward path £(r) and the corresponding reversed trajectory (backward path), 
e{r) = e{t - r): 

Ses[e] - S^^e] = [ V'edT = -As^. (38) 



This formula along the medium entropy defined by the relation f l3T|l shows that this is the 
entropy generation in the medium, Asm, which is solely responsible for the change in the 
weight under "time reversal": P[£]/P[e] = exp(Asm)- 

Note that, for suitably defined dissipation function, this result can be regarded as a 
version of the Evans-Searles fluctuation theorem [3^. It is also applicable to externally 
driven Brownian systems. In this case, there is a set of external control parameters, 
A(r) = {Ai(r), . . . , Afc(r)}, that vary in time from Aq = A(0) to A^ = X(t) according to 
the prescribed (forward) protocol, whereas the reversed (backward) protocol is represented 
by the parameters A(r) = \(t — r). The energy potential, V = V{e, X(t)), and the diffusion 
coefficient, D = D{e,X{t)), are now a function of the time- dependent parameters, so that 
the FP and flux operators are both non-stationary. 

Despite the evolution operator, U(t,to), is no longer given by the exponential solution 
W(t,to) = exp[— (t — to)'^] to the Cauchy problem f lT5]) with the stationary FP Hamiltonian, 
the expression for the effective action ( 137|) remains intact and its protocol dependent dif- 
ference, S'eff[e, A] — S'eflf[e, A], is still given by the formula ( 138|) . where V = V'{e,X). This 
formula and the inequality (IMj) justify our definition of the entropy of the environment. 



B. Generalized integral fluctuation relation 



In general, there are a number of relations that can be derived by making the comparison 
between the trajectories and reversed "anti-trajectories" . Some of these — the so-called the 
fluctuation theorems — were recently reviewed in Refs. 37-39[. The fluctuation relations 



were tested experimentally in a variety of different systems such as colloidal particles ma- 



nipulated by laser traps |40|-|46| , biomolecules pulled by AFM's or optical tweezers |47|, |48| 
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atomic force microscopy cantilever and an electric circuit with an imposed mean cur- 
rent [46]. 

In this section we apply the operator approach to deduce the integral fluctuation relation 
that can be regarded as the generalized version of the well-known Hatano-Sasa identity jsoj. 
We also discuss how to recover other known results such as the Jarzynski's equality |5l| and 
the relation for the total entropy obtained by Seifert in Ref. po|. Note that the fluctuation 
relations for stochastic systems originally studied in Refs. 124. J36l. 
extended to the case of inhomogeneous stochastic processes [54-:56l| . 



were recently 



Our flrst step is to introduce a family of the modifled FP operators 



Tip = -de -Jp, Jp = J - p/p: 



'st; 



(39) 



where p is a real number which might be called the flux parameter. From Eq. fl39|l it can 
be seen that the operator (fT^ . "H = "Hq; transforms into "Hp with the shifted flux operator 
Jp when the energy derivative of the potential V is replaced with V — p/{Dpst). So, the 
energy potential, Vp, for the deformed FP operator T-Lp is given by 



Vp 



V 



p_ 
J. 



In 



St 



1 + Jst/iVst/ eMV{s)}/D{E')de' 



(40) 



where the potential V is deflned in Eq. f lT2|l . 

It is straightforward to check the validity of the algebraic identity 



Hi = Jl ■ 9e = e^ 



Uq ■ e" 



q = 2Jst -p. 



St 



-Inp, 



St) 



(41) 
(42) 



where the superscript f stands for Hermitian conjugation, linking the Hermitian conjugate 
of the deformed FP operator fl39l) . Wp, at p = Jst + A J and the operator Tig with the flux 
parameter q = 2 Jst — P = Jst — A J through the steady state potential \I^st, of the stationary 
distribution, p^t, characterized by the flux number (stationary probability flux) J^t- 

Another important point is that the evolution operator Up{t, 0; A) of the deformed Hamil- 
tonian f l39|) computed at the reversed protocol A preserves the normalization condition of 
a probability distribution function pf-. (l|pf) = (pf|l) = / p{{e) de = 1. Our method is to 
combine the normalization preserving condition 



(l|^,(t,0;A)|pf) = (pf|Wt(t,0;A)|l) = (pf|l) = 1 



(43) 



with the identity fjlTjl . To this end, we slice the time interval [0, t] into a large number + 1 
of small pieces of the thickness At = t/{N + 1) and approximate the evolution operator 
i^piji^ Ti-i] A), where r, = rj_i + At and Tq = 0, by the operator exponent exp[— Ar'Hp(Aj)], 
where Aj = A(rj) = Aat+i^j. Then, by using the identity f l4T|) . the discretized evolution 
operator 



Wi(t,0;A) 



-AtWp(Ao) . -ArHpiXi) 



-AtHp{Xn) 



(44) 



can be recast into the following operator product 



UUt,0;X)^p],'-e 



-ArHqiXo) . 



Po, 



(45) 
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where pi = Pst{K) and exp[-A^j] = Pi/pi^i. 

Assuming that the initial probabihty distribution is pin, we derive the equahty 

</X|g-(%-*]v) . g-Ar-Hg(Aiv) . g-Av&iv . . .g-AT-Hg(Ai) . g-AvI-i . ^-ArHgiXo) . e*'"""^" | pi^) = 1, (46) 

where \l/in,f = — lnpin,f, which, in the hmit of large slice number, — )■ oo, gives our key 
result in the form of the identity 

exp|-£^A«dr + AvI/i,-Avl/f}^ =1, (47) 

where A^i„ = - ^st(Ao) = - ln[pi„/p3t(Ao)] and A^f - ^,t(At) = - ln[pf/p3t(At)]. 
and the index q indicates using the deformed FP operator Tiq. 

The relation fH7|) involves the flux parameter, q, and the two probability distributions, 
Pf and Pin- In what follows we concentrate on the important case of non-deformed effective 
potential, where the flux parameter q is zero and p = 2Jst. On substituting pin = Pst(Ao) 
and Pf =_Pst(At) into the identity ( H7|) . we recover the result obtained by Hatano and Sasa 
in Ref. |50| 

6xp|-/'l^^odr)Ul (48) 



\ ^ Jo 

which is just the special case of the relation fHTl) with g = and A\E'in^f = 0. 

When the stationary flux vanishes and Jgt = 0, the steady state distribution is given in 
Eq. f lTSj) with \&st = ^ — -Pst, so that the Hatano-Sasa formula fj48l) can be rewritten as the 
Jarzynski's equality (5ll | 

^expj-^ |^A„dr}^ =exp{-AF3t}, (49) 

where AF,, = F,^{\t) - F,,{\o) . 
Since the integral 



dV 

9Xa 



A„dr = Ay- / V edr = AV + As^ (50) 







can be expressed in terms of the entropy of the medium fl3T]) . at Jgt = 0, the relation f H7|l 
takes the following form 

exp{-As^ -(^f -$;„)}) = 1 (51) 



that reduces to the integral fluctuation theorem for the total change in entropy [30|, l57|, l58 



exp{-Astot}^ = 1 (52) 

when |pf) = W(t,0)|pin) and As = \E'f — \E'in. From Eq. fl52|) combined with the Jensen's 
inequality (exp(x)) > exp(a;), the averaged change in the total entropy cannot be negative, 
so that, in agreement with Eq. (15^ and the second law of thermodynamics, (Astot) > 0. 
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So, we have found that the well-known results such as the Hatano-Sasa identity fl48p . the 
Jarzynski's equality f l49p and the fluctuation theorem for the total entropy fl52p immediately 
follow from our generalized fluctuation relation (1470 derived for nonzero flux parameters. 

Our concluding remark concerns the generalized fluctuation-exchange theorem for the 
steady-state systems formulated in a very recent paper [59|. This theorem is essentially a 
direct consequence of the Hatano-Sasa identity fHHl) applied to the limiting case of small 
perturbations, where A(t) = Aq -l- SX(t). More specifically, it asserts that the response 
functions 



of the averages 



(^,(t)) = (l|^,-W(t,0)|po>, - 



> Po = Pst\^=^^ (54) 

A=Ao 



dX 

meet the fluctuation-exchange relation 

Rapit-r) = dtC^0it-T), (55) 
where Cai3{t — r) is the correlation function given by 

Caf^it -r) = {^^{t)^fs{r))^ = ■ exp[-(t - r)H(Ao)] ■ ^;3|po>. (56) 

From the above considerations, the formulas f lS^ - fISB]) written down explicitly in the bracket 
notations are applicable to the Brownian systems in the energy representation. We shall 
extend on the subject elsewhere. 



V. DISCUSSION AND CONCLUSIONS 

In this paper we have demonstrated that the method that combines the energy represen- 
tation with the Langevin dynamics approach may provide an effective tool to explore the 
steady states of certain nonequilibrium Brownian systems. These states can be analytically 
studied as the stationary solutions of the corresponding FP equation expressed in terms of 
the exchange and diffusion functions, f{e) and g{e). 

The function of energy exchange rate, /, defined as the deterministic part of the Langevin 
equation ([7]) describes the process of direct energy interchange between the system and the 
environment, whereas the multiplicative white noise characterized by the diffusion function 
g represent the fluctuation induced effects. The latter may depend on the energy of the 
system and hence the diffusion function is generally not a constant. 

We have shown that, in the limit of low noise with g ^ 0, the steady states are determined 
by equilibria of the effective potential, E, defined in Eq. (122|) . At g = go 0, these equilibria 
correspond to the maxima of the steady state (stationary) distribution, pst (|T8l) . 

In the well-known case of linear exchange function, / = 7(5 — Eq), the system losses its 
energy via the processes of dissipation when the friction coefficient is positive 7 > 0. Then 
the energy is the only equilibrium point of the harmonic potential, E = 7(5 — Eq)'^/2, 
and, at energy independent diffusion function g = go, the steady state distribution is of the 
Gaussian form: p^t = iVexp [— 7(£ — £oY/ (2-Do)] • 
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In the opposite case of negative friction coefficient with 7 < 0, the system absorbs the 
energy from the environment and there are no steady states without mechanisms hmiting the 
gain of energy. Interestingly, we have found that, when the friction coefficient depends on the 
energy and contains the random contribution coming from the environment stochasticity, the 
steady state distribution may take the form of the standard Maxwell equilibrium distribution 
for Brownian particles (the conditions can be found below Eq. f l2^ ). 

So, using our approach it is relatively easy to conclude on stationary distribution func- 
tions of nonequilibrium Brownian systems for different mechanisms of energy interchange 
complicated by the stochastic nonlinear coupling with the environment. In particular, it is 
not difficult to recover the results on statistics of energy states obtained in Ref. [l6[ for a 
generic model of a random polypeptide chain that reproduces the energy probability distri- 
bution of real proteins over a very large ran ge o f energies. It is also pertinent to note that 
the systems such as dust particles in plasma |60| and Brownian particles with the randomly 
inhomogeneous friction coefficient present important cases for which theoretical predictions 
can be experimentally verified, but this task requires additional analysis and experimental 
data. 

As first steps in this direction, we have introduced the trajectory-dependent entropy in 
the energy representation so as to define both the entropy of the Brownian system and the 
entropy production in the environment. The latter, similar to the steady state distributions 
at Jst = 0, was found to be determined by the effective energy potential flT^ . 

As far as the fluctuation relations are concerned, our key flnding is the generalized inte- 
gral fluctuation theorem P7|) describing nonequilibrium Brownian systems with the shifted 
effective potential characterized by the flux parameter, q, and the flux number, J^t (the 
stationary value of the probability current). It turned out that the fluctuation theorem for 
the total entropy change fl52p can be deduced from this theorem. The Hatano-Sasa iden- 
tity fj^Hjl and the Jarzynski's equality fj49|) can equally be derived as the special cases of our 
fluctuation relation fH7j) . 

At p = Jst = 0, the algebraic identity f HT]) reduces to the detailed balance relation 



for the steady state distribution of the potential form ffTSj) . In the opposite case characterized 
by nonzero flux number, Jst 7^ 0, and non-reflecting boundary conditions, the identity pij) 
describes the systems where detailed balance is violated. Alternatively, in multidimensional 
systems, explicit violation of detailed balance can be caused by non- conservative forces jGlj . 

From the integral theorem (H7I) . and, following the line of reasoning presented in Ref. j62|, 
it can be concluded that the energy representation serves as a coarse-grained description 
of stochastic systems where the energy can be viewed as the reduced variable such that 
information on its trajectories is enough to reproduce the statistics of the entropy production. 

Our concluding remark concerns the detailed theorem that underlies the integral fluctu- 
ation relation (jUj). According to the general results of the very recent paper G^], when a 



variable obeys an integral fluctuation theorem, it automatically obeys a detailed theorem. 
So, the relation WJ\ . additionally idicates that, in the energy representation, there are 
detailed fluctuation theorems describing Brownian-like systems in the absence of detailed 
balance. These theorems and related analysis are beyond the scope of this paper. We shall 



16 



extend on this subject elsewhere. 
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